|
|
Confidence Intervals for Quantiles
Horejšová, Markéta ; Kulich, Michal (advisor) ; Hlávka, Zdeněk (referee)
In this thesis, various construction methods for simultaneous confidence intervals for quantiles are explained. Among nonparametric approaches, a special emphasis is dedicated to a recent method based on a multinomial distribution for calculating the overall confidence level of confidence intervals for all quantiles of interest using an efficient recursive algorithm, which is also described. Furthermore, a method based on Kolmogorov-Smirnov statistic or an asymptotic method using empirical distribution function and order statistics for quantile estimate are presented. A special parametric method for several quantiles of a normally distributed population is introduced along with a few of its modifications. Subsequently, a simulation is run to test the real coverage of the described theoretical methods. Powered by TCPDF (www.tcpdf.org)
|
|
|
Confidence Intervals for Quantiles
Horejšová, Markéta ; Kulich, Michal (advisor) ; Hlávka, Zdeněk (referee)
In this thesis, various construction methods for simultaneous confidence intervals for quantiles are explained. Among nonparametric approaches, a special emphasis is dedicated to a recent method based on a multinomial distribution for calculating the overall confidence level of confidence intervals for all quantiles of interest using an efficient recursive algorithm, which is also described. Furthermore, a method based on Kolmogorov-Smirnov statistic or an asymptotic method using empirical distribution function and order statistics for quantile estimate are presented. A special parametric method for several quantiles of a normally distributed population is introduced along with a few of its modifications. Subsequently, a simulation is run to test the real coverage of the described theoretical methods. Powered by TCPDF (www.tcpdf.org)
|
|
|
Quality measures of classification models and their conversion
Hanusek, Lubomír ; Hebák, Petr (advisor) ; Řezanková, Hana (referee) ; Skalská, Hana (referee)
Predictive power of classification models can be evaluated by various measures. The most popular measures in data mining (DM) are Gini coefficient, Kolmogorov-Smirnov statistic and lift. These measures are each based on a completely different way of calculation. If an analyst is used to one of these measures it can be difficult for him to asses the predictive power of a model evaluated by another measure. The aim of this thesis is to develop a method how to convert one performance measure into another. Even though this thesis focuses mainly on the above-mentioned measures, it deals also with other measures like sensitivity, specificity, total accuracy and area under ROC curve. During development of DM models you may need to work with a sample that is stratified by values of the target variable Y instead of working with the whole population containing millions of observations. If you evaluate a model developed on a stratified data you may need to convert these measures to the whole population. This thesis describes a way, how to carry out this conversion. A software application (CPM) enabling all these conversions makes part of this thesis. With this application you can not only convert one performance measure to another, but you can also convert measures calculated on a stratified sample to the whole population. Besides the above mentioned performance measures (sensitivity, specificity, total accuracy, Gini coefficient, Kolmogorov-Smirnov statistic), CPM will also generate confusion matrix and performance charts (lift chart, gains chart, ROC chart and KS chart). This thesis comprises the user manual to this application as well as the web address where the application can be downloaded. The theory described in this thesis was verified on the real data.
|
guest ::
